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REMARKS 

Claims 3-28 and 30-33 are pending and under consideration. Further reconsideration is 
requested based on the foregoing amendment and the following remarks. 

Interview Summary 

The Applicants submit the following summary of the Office interview that took place 
February 13, 2006 between the undersigned representative of the Applicants and the Examiner. 

Office Conference: 

The Applicants thank the Examiner for the many courtesies extended to the undersigned 
representative of the Applicants during the Office interview that took place February 1 3, 2006. 

Among the issues discussed during that interview was the patentability of the claims over 
the cited references. The Examiner agreed to review the rejections upon receipt of this further 
response. 

Response to Arguments: 

The Applicants appreciate the consideration given to their arguments filed August 22, 
2005. The Applicants, however, are disappointed that their arguments were not found to be 
persuasive. The final Office Action responded to our arguments at page 2 by asserting, with 
respect to Seeger, that since Seeger describes generation of a background image, and uses the 
image for determining offset values, and that global and local offset values are computed based 
on an average difference between the background threshold surface pixel values, Seeger shows 
calculating a gray level difference. The final Office Action thus appears to have focused 
exclusively on the phrase "calculating a gray level difference," while neglecting most of the rest 
of the recitation of claim 3. 

Claim 3, however, further defines a gray level difference as an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel. Even if one focuses exclusively on the final Office Action's preferred passages of Seeger, 
it is apparent that Seeger defines no gray level difference, let alone one that is calculated based 
on a difference between an average gray level of white pixels in the vicinity area of the target 
pixel and an average gray level of black pixels in the vicinity area of the target. In Seeger rather, 
as described in at column 5, lines 34-41, which were cited by the final Office Action: 

Next, in box 502 an offset value d is computed. For one embodiment of the 
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present invention, the offset value d is a global offset which is computed based 
upon the average difference between background threshold surface pixel values 
Bp and grey-scale image pixel values l p for pixels at which the grey-scale pixel 
values are less than the background surface pixel values (e.g., I p <B P ). 

Thus, the offset value d in Seeger is computed based upon the average difference between 
background threshold surface pixel values B p and grey-scale image pixel values l p . 
Furthermore, the computation of offset value d is restricted to those pixels at which the grey- 
scale pixel values are less than the background surface pixel values (e.g., I p <B P ). This is not 
the same as calculating a gray level difference as an amount based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel. 

The final Office Action responded to our arguments with respect to the Hongo reference 
in the last paragraph on page 2 by asserting that Hongo shows binarizing being performed on 
the basis of a judgment. As you may recall, we argued in our remarks filed August 22, 2005 that 
one difference between the claimed invention and Hongo is exactly that. In particular, we 
argued that, in Hongo, binarization is performed on the basis of a judgment as to whether each 
pixel is a character line pixel or not, La. the judgment is part of the binarization process. We 
contrasted this with claim 4, in which a judgment is made as to whether a target pixel belongs to 
the background or a stroke beforehand, and then a binary image is output if ft is judged that the 
target pixel is not the background pixel. 

We wish, therefore, to draw the final Office Action's attention to the paragraph of Hongo 
at column 3, lines 45 and 46, preceding immediately the section of Hongo cited by the final 
Office Action, which provides: 

Binarizing is performed on the basis of a judgment as to whether each pixel is a 
character line pixel. 

Thus, Hongo does indeed perform binarization on the basis of a judgment as to whether each 
pixel is a character line pixel or not, Le. the judgment is part of the binarization process, as the 
final Office Action acknowledged, and therefore one difference between Hongo and claim 4 is 
that, in claim 4, a judgment is made as to whether a target pixel belongs to the background or a 
stroke beforehand, and then a binary image is output if ft is judged that the target pixel is not the 
background pixel. Further reconsideration is thus requested. 
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Claim Rejections - 35 U.S.C. § 102: 

Claim 3 was rejected under 35 U.S.C. § 102(e) as anticipated by Seeger etaL, US 
6,577,762 (hereinafter "Seeger"). The rejection is traversed to the extent it would apply to the 
claims as amended. 

Claim 3 recites: 

The gray level difference is an amount which is calculated based on a difference 
between an average gray level of white pixels in the vicinity area of the target 
pixel and an average gray level of black pixels in the vicinity area of the target 
pixel. 

Seeger neither teaches, discloses, nor suggests a "gray level difference is an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel," as recited in claim 3. The passage to which the final Office Action refers, at column 6, line 
63 through column 9, line 17 of Seeger, rather, begins by describing: 

FIG. 8 illustrates a block variance image 800 of grey-scale image 100 shown in 
FIG. 1. The dark regions indicate low variance regions and the light regions 
indicate high variance regions. In general, the background pixels are typically 
represented by the low variance regions and the foreground pixels are 
represented by the high variance regions. This is based on the assumption that 
grey-scale values change slowly with position if a region is background. This is 
generally true if the text is printed on a page of uniform color and lighting 
variations are caused by diffuse shadows. Since text has sharp boundaries the 
variance of a region is typically larger that the background variance if the region 
includes edges of characters. 

This passage of Seeger may be seen to describe a block variance image 800 of grey-scale 
image 100, rather than a "gray level difference is an amount, which is calculated, based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as recited in 
claim 3. A variance is not a difference. Seeger says nothing at all here about a "gray level 
difference is an amount, which is calculated, based on a difference between an average gray 
level of white pixels in the vicinity area of the target pixel and an average gray level of black 
pixels in the vicinity area of the target pixel," as recited in claim 3, contrary to the assertion in the 
final Office Action. 

Seeger goes on to describe, at column 7, line 9-18: 

Referring back to FIG. 6, in box 603, a moving average of the block variance 
image V is computed by taking the mean of all possible windows of a specified 
size. The mean variance image V indicates whether the variance of a block is 
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bigger or smaller than the average variance. If it is larger than the average 
variance then there is probably text in this region. So the window size determines 
over what area this average variance is computed. If this window is too small, 
then it's a poor measure of the average, if it is too big it does not reflect local 
changes accurately. 

Similarly, this passage of Seeger may be seen to describe computation of a moving average of 
the block variance image V by taking the mean of all possible windows of a specified size, rather 
than a "gray level difference is an amount, which is calculated, based on a difference between 
an average gray level of white pixels in the vicinity area of the target pixel and an average gray 
level of black pixels in the vicinity area of the target pixel," as recited in claim 3. A moving 
average of a block variance is not a difference, either. Seeger says nothing at all here about a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3, contrary to the 
assertion in the final Office Action. 

Seeger goes on to describe, at column 7, line 19-39: 

For one embodiment of the present invention, the mean variance image V is 
based on a 15 by 15 pixel block moving average of block variance image V. This 
particular window size (e.g., 15 by 15 pixel block) was selected based upon 
experimental results. For alternative embodiments, the size of this window may 
vary. In general, the larger the window size, the smoother the block variance 
image V. 

Next, in box 604, a variance threshold surface V t can be computed based on the 
following equation: 

V t =aV+N 

where, a is a constant and N represents an estimate of the variance due to noise 
in the background region. The constant a is determined empirically. For one 
embodiment of the present invention, a =0.3 and N=16 was used for an initial 
pass of the algorithm. In a second pass, N may be replaced with the average 
variance of the background. The average variance of the background is 
computed by taking the average of those pixels in block variance image V which 
correspond to the background regions (as determined by V t ). Box 608 illustrates 
the iterative updating of N. 

Similarly, this passage of Seeger may be seen to describe computation of a variance threshold 
surface V t , rather than a "gray level difference is an amount, which is calculated, based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as recited in 
claim 3. A variance threshold surface is not a difference, either. Seeger says nothing at all here 
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about a "gray level difference is an amount, which is calculated, based on a difference between 
an average gray level of white pixels in the vicinity area of the target pixel and an average gray 
level of black pixels in the vicinity area of the target pixel," as recited in claim 3, contrary to the 
assertion in the final Office Action. 

Seeger goes on to describe, at column 7, lines 40-46: 

In box 605, the block average image I is segmented by thresholding the block 
variance image V with the variance threshold surface V t . The variance threshold 
surface V t is used to remove text regions from the block average image I. In other 
words, the block average image I is segmented into foreground and background 
regions based upon the variance threshold surface V t and the block variance 
image V. 

Similarly, this passage of Seeger may be seen to describe using variance threshold surface V t to 
remove text regions from the block average image I, rather than a "gray level difference is an 
amount, which is calculated, based on a difference between an average gray level of white 
pixels in the vicinity area of the target pixel and an average gray level of black pixels in the 
vicinity area of the target pixel," as recited in claim 3. Seeger says nothing at all here about a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3, contrary to the 
assertion in the final Office Action. 

Seeger goes on to describe, at column 7, lines 47-55: 

For example, if a pixel in the block variance image V is larger than a 
corresponding pixel in the variance threshold surface V t then a corresponding 
pixel in the block average image I is designated as a foreground pixel, otherwise 
it is designated as a background pixel. All designated foreground pixels may be 
assigned a first value and/or all designated background pixels may be assigned a 
second value. For one embodiment of the present invention, all text regions are 
assigned a unique pixel value (e.g., 0). 

Similarly, this passage of Seeger may be seen to describe designating pixels in the block 
average image I as foreground pixels or background pixels based on whether a pixel in the block 
variance image V is larger than a corresponding pixel in the variance threshold surface V t( or 
not, rather than a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3. 
Seeger says nothing at all here about a "gray level difference is an amount, which is calculated, 
based on a difference between an average gray level of white pixels in the vicinity area of the 
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target pixel and an average gray level of black pixels in the vicinity area of the target pixel," as 
recited in claim 3, contrary to the assertion in the final Office Action. 

Seegergoes on to describe, at column 7, lines 56-62: 

For one embodiment of the present invention, each pixel in the block average 
image I, the block variance image V t and the variance threshold surface V t 
corresponds to a pixel block (e.g., 7 by 7 pixel block) in the grey-scale image I. 
FIG. 9 illustrates a block average image 900 after applying the variance threshold 
V t . Image 900 is segmented into text and background regions. 

Similarly, this passage of Seeger may be seen to explain that each pixel in the block average 
image I, the block variance image V t and the variance threshold surface V t corresponds to a 
pixel block (e.g., 7 by 7 pixel block) in the grey-scale image I, rather than a "gray level difference 
is an amount, which is calculated, based on a difference between an average gray level of white 
pixels in the vicinity area of the target pixel and an average gray level of black pixels in the 
vicinity area of the target pixel," as recited in claim 3. Seeger says nothing at all here about a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3, contrary to the 
assertion in the final Office Action. 

Seeger goes on to describe, at column 7, lines 63 to column 8, line 8: 

In box 606, a background image B is obtained by replacing pixel values in a block 
average image I, labeled as foreground (or text) regions with interpolated values. 
For one embodiment of the present invention, a block average image I is 
interpolated linearly along rows and columns using neighboring background 
regions. The final result is obtained by averaging the row and column 
interpolates. For alternative embodiments, rather than using linear interpolation, it 
is possible to fit a smooth surface to the existing data points. In this way, 
smoothness constraints can be incorporated to reduce the high frequency 
contribution of text caused by false segmentation. FIG. 10 illustrates a 
background image 1000 for the grey-scale image 100. 

Similarly, this passage of Seeger may be seen to describe interpolating block average image I 
linearly along rows and columns using neighboring background regions, rather than a "gray level 
difference is an amount, which is calculated, based on a difference between an average gray 
level of white pixels in the vicinity area of the target pixel and an average gray level of black 
pixels in the vicinity area of the target pixel," as recited in claim 3. Seeger says nothing at all 
here about a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
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average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3, 
contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 9-16: 

In box 607, the background image B is then upsampled to increase the resolution 
to match the resolution of the original grey-scale image I. For example, the 
background image B is upsampled by a factor of 7 in each direction when using 7 
by 7 pixel blocks to compute the block average image I. For one embodiment of 
the present invention, the background image B is upsampled using bilinear or 
bicubic interpolation by the block size. 

Similarly, this passage of Seeger may be seen to describe upsampling the background image B 
to increase the resolution to match the resolution of the original grey-scale image I, rather than a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3. Seeger says nothing 
at all here about a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3, 
contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 17-23: 

For one embodiment of the present invention, the background image B generated 
by logic flow diagram 600 is then used for determining the offset value(s) d in 
accordance with box 502 and thresholding the grey-scale image I in accordance 
with box 503. The binary image 400 illustrates the results of applying the 
background surface thresholding method described above. 

Similarly, this passage of Seeger may be seen to describe using the background image B 
generated by logic flow diagram 600 for determining the offset value(s) d in accordance with box 
502 and thresholding the grey-scale image I in accordance with box 503, rather than a "gray 
level difference is an amount, which is calculated, based on a difference between an average 
gray level of white pixels in the vicinity area of the target pixel and an average gray level of black 
pixels in the vicinity area of the target pixel," as recited in claim 3. An offset value is not a 
difference. Seeger says nothing at all here about a "gray level difference is an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel," as recited in claim 3, contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 24-31 : 
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It should be noted that boxes 601 , 602, 603, 604 and 605 represent the initial 
segmentation of the grey-scale image I into foreground and background regions. 
For alternative embodiments of the present invention, the initial segmentation of 
grey-scale image/may be performed using a histogram analysis of the variance to 
determine the variance threshold, edge or high frequency detection, or any other 
segmentation technique. 

Similarly, this passage of Seeger may be seen to explain that boxes 601 , 602, 603, 604 and 605 
represent the initial segmentation of the grey-scale image I into foreground and background 
regions, rather than a "gray level difference is an amount, which is calculated, based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as recited in 
claim 3. Seeger says nothing at all here about a "gray level difference is an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel," as recited in claim 3, contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 32-39: 

For alternative embodiments of the present invention, the background 
thresholding technique described in logic flow diagrams 500 and 600 may be 
performed in an iterative manner. This can be accomplished by replacing the 
initial segmentation into text and background (using variance thresholds) with the 
output of the previous background surface thresholding result as shown by arrow 
505 in FIG. 5. 

Similarly, this passage of Seeger may be seen to explain that the background thresholding 
technique described in logic flow diagrams 500 and 600 may be performed in an iterative 
manner, rather than a "gray level difference is an amount, which is calculated, based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as recited in 
claim 3. Seeger says nothing at all here about a "gray level difference is an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel," as recited in claim 3, contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 40-50: 

The background surface thresholding techniques described above can be used 
to segment grey-scale images, color (e.g., based on red, green or blue or cyan, 
magenta or yellow) images, and any other type of pixmap image. In other words, 
the background thresholding techniques described by the logic flow diagrams 500 
and 600 can be applied to grey-scale images and color images. However, when 
binarizing color images in accordance with the background thresholding 
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techniques described in logic flow diagrams 500 and 600 some additional 
processing may be required. 

Similarly, this passage of Seeger may be seen to explain that the background surface 
thresholding techniques described above can be used to segment grey-scale images, color 
(e.g., based on red, green or blue or cyan, magenta or yellow) images, and any other type of 
pixmap image, rather than a "gray level difference is an amount, which is calculated, based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as recited in 
claim 3. Seeger says nothing at all here about calculating a "gray level difference is an amount, 
which is calculated, based on a difference between an average gray level of white pixels in the 
vicinity area of the target pixel and an average gray level of black pixels in the vicinity area of the 
target pixel," as recited in claim 3, contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 51-56: 

For example, the luminance of a color image can be computed before applying 
the background surface thresholding technique. Alternatively, the background 
thresholding technique can be applied to each color channel separately so that 
the results of each channel can be combined in some manner, for example by 
AND-ing or OR-ing. 

Similarly, this passage of Seeger may be seen to explain that the luminance of a color image can 
be computed before applying the background surface thresholding technique, rather than a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3. Seeger says nothing 
at all here about a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3, 
contrary to the assertion in the final Office Action. 

Seeger goes on to describe, at column 8, lines 57 to column 9, line 6: 

The binary image may be further enhanced by performing additional image 
processing techniques on the grey-scale image prior to performing the 
background surface thresholding techniques described above. For example, a 
de-blurring technique used to partially restore the degradations of the image due 
to camera or motion blur may precede the background threshold surfaces 
techniques. Although there are numerous de-blurring techniques available, a 
sharpening technique described in "Fundamentals of Digital Image Processing", 
Anil K. Jain, pp. 249-250, (1989) or FIR filtering technique which assumes a 
Gaussian point spread function (PSF) described in "Small Convolution Kernels 
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for High-Fidelity Image Restoration", S. Reichenbach and S. Park, IEEE Trans. 
Signal Processing 39(10), (1991) are generally sufficient if the PSF cannot be 
determined accurately. These techniques yield good results and are 
computationally efficient. 

Similarly, this passage of Seeger may be seen to explain that binary image may be further 
enhanced by performing additional image processing techniques on the grey-scale image prior 
to performing the background surface thresholding techniques described above, rather than a 
"gray level difference is an amount, which is calculated, based on a difference between an 
average gray level of white pixels in the vicinity area of the target pixel and an average gray level 
of black pixels in the vicinity area of the target pixel," as recited in claim 3. Seeger says nothing 
at all here about a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3, 
contrary to the assertion in the final Office Action. 

Finally, Seeger goes on to describe, at column 9, lines 7-17: 

Upsampling is another technique that may be used to enhance the grey-scale 
image prior to performing background surface thresholding. Upsampling prior to 
binarization helps to trade grey-scale resolution for spatial resolution. Upsampling 
may be performed by bilinear or bicubic upsampling of the grey-scale image by a 
factor of 3 or other upsampling methods such as edge preserving interpolation 
schemes. An example of such an edge preserving interpolation scheme is 
disclosed in Allebach, J. P., and Wong, P. W., "Edge directed interpolation", in 
Proceedings of IEEE International Conference on Image Processing, ICIP-96, 
September 1996, Lausanne, Switzerland, pp. 707-710. 

Finally, this passage of Seeger may be seen to explain that upsampling may be used to enhance 
the grey-scale image prior to performing background surface thresholding, rather than a "gray 
level difference is an amount, which is calculated, based on a difference between an average 
gray level of white pixels in the vicinity area of the target pixel and an average gray level of black 
pixels in the vicinity area of the target pixel," as recited in claim 3. Seeger says nothing at all 
here about a "gray level difference is an amount, which is calculated, based on a difference 
between an average gray level of white pixels in the vicinity area of the target pixel and an 
average gray level of black pixels in the vicinity area of the target pixel," as recited in claim 3, 
contrary to the assertion in the final Office Action. Claim 3 is submitted to be allowable. 
Withdrawal of the rejection of claim 3 is earnestly solicited. 
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Claims 4-1 0. 1 2. 1 3. 1 5-28. 30. 31 . 32, and 33: 

Claims 4-10, 12, 13, 15-28, 30, 31, 32, and 33 were rejected under 35 U.S.C. § 102(b) as 
anticipated by Hongo etaL, US 4,903,316 (hereinafter "Hongo"). The rejection is traversed to 
the extent it would apply to the claims as amended. 

Independent claims 4, 23, 26, 31, 32, and 33 of the invention are directed to determining, 
for each target pixel, whether the target pixel is a background pixel and to locally binarizing the 
target pixel by determining whether the target pixel belongs to the background or a stroke the 
and outputting a binary image if the target pixel is not a background pixel. That is, a 
determination is made whether the pixel is a background pixel or a stroke pixel before 
performing a local binarization process and then the local-binarization is performed depending 
on whether the target pixel is determined to be in the background. By determining whether a 
target pixel is a background pixel prior to the local binarization process, the occurrence of a 
black and white flickering type noise can be suppressed at a low calculation cost (see 
application page 6, lines 20-23). 

Claim 4, in particular, recites: 

Locally binarizing the target pixel, judging which of a background and a stroke the 
target pixel belongs to, and outputting a binary image if it is judged that the target 
pixel is not the background pixel. 

Hongo neither teaches, discloses, nor suggests locally binarizing the target pixel, judging which 
of a background and a stroke the target pixel belongs to, and outputting a binary image if it is 
judged that the target pixel is not the background pixel, as recited in claim 4. The passage to 
which the final Office Action refers, at column 8, lines 10-17 of Hongo, rather, describes: 

As shown in FIG. 19, a target subwindow WS 0 and eight surrounding subwindows 
WSi -WS 7 disposed around the target subwindow are formed such that each of 
the subwindows has 3X3 pixels and binarizing is performed on the basis of a 
judgement as to whether each pixel is a character line pixel. A target pixel is a 
character line pixel when the following two conditions are satisfied. 

Thus, Hongo is describing performing binarization on the basis of a judgement as to whether 
each pixel is a character line pixel or not, Le^ the judgment is part of the binarization process. 
This is to be contrasted with claim 4, in which a judgement is made as to whether a target pixel 
belongs to the background or a stroke beforehand, and then a binary image is output /fit is 
judged that the target pixel is not the background pixel. 

The final Office Action finds this statement, made in the Remarks filed previously on 
October 28, 2004, to mean that the determination is made prior to binarization. It's unclear how 
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performing binarization on the basis of a judgement as to whether each pixel is a character line 
pixel amounts to judging whether a target pixel belongs to the background or a stroke, and then 
a binary image is output /fit is judged that the target pixel is not the background pixel, as recited 
in claim 4. Further reconsideration of the rejection of Independent claims 4, 23, 26, 31 and 32 is 
therefore requested respectfully. 

Furthermore, the Abstract of Hongo describes: 

A binarizing apparatus used for optical character readers or character-and- 
graphic input devices, in which a sharp binary image can be obtained even from 
low-contrast character lines (or line segments) by discriminating a line graphic 
from stains wider than the character lines or from blurs in the background thereof. 
Eight surrounding subwindows are disposed around a target subwindow 
enclosing a target pixel, the surrounding subwindows being separated from each 
other at a distance larger than the character line width, and each of the 
subwindows having 3. times. 3 pixels. The average density value of the respective 
subwindow is calculated to thereby compare the respective density values of the 
target subwindow and each surrounding subwindow or compare the density 
values of the respective surrounding subwindows. Consequently, whether the 
target pixel belongs to character line or whether it does not belong thereto, is 
judged to thereby perform binarizing. 

Here, again, Hongo describes literally, "Consequently, whether the target pixel belongs to 
character line or whether it does not belong thereto, is judged to thereby perform binarizing." 
Thus, Hongo performs binarizing based on whether the target pixel belongs to character line or 
not, Le. the judgment is part of the binarization process. This is to be contrasted with claim 4, in 
which a judgment is made as to whether a target pixel belongs to the background or a stroke 
beforehand, and then a binary image is output /fit is judged that the target pixel is not the 
background pixel. Claim 4 is thus submitted to be allowable. Withdrawal of the rejection of 
claim 4 is earnestly solicited. 

Claims 5-10, 12, 13, and 15-22 depend from claim 4 and add further distinguishing 
elements. Claim 15, for example, emphasizes that a fixed shape line element mask is used for 
line restriction. Claims 5-10, 12, 13, and 15-22 are thus also submitted to be allowable. 
Withdrawal of the rejection of claims 5-10, 12, 13, and 15-22 is also earnestly solicited. 

Claims 23-25: 

Claim 23 recites: 

Locally binarizing the target pixel, judging which of a background and a stroke the 
target pixel belongs to and outputting a binary image if it is judged that the target 
pixel is not the background pixel. 
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Hongo neither teaches, discloses, nor suggests locally binarizing the target pixel, judging which 
of a background and a stroke the target pixel belongs to and outputting a binary image if it is 
judged that the target pixel is not the background pixel, as discussed above with respect to the 
rejection of claim 4. Claim 23 is thus submitted to be allowable for at least those reasons given 
above with respect to the rejection of claim 4. Withdrawal of the rejection of claim 23 is 
earnestly solicited. 

Claims 24 and 25 depend from claim 23 and add further distinguishing elements. Claims 

24 and 25 are thus also submitted to be allowable. Withdrawal of the rejection of claims 24 and 

25 is also earnestly solicited. 

Claims 26-28: 

Claim 26 recites: 

Locally binarizing the target pixel, judging which of a background and a stroke the 
target pixel belongs to and outputting a binary image if it is judged that the target 
pixel is not the background pixel. 

Hongo neither teaches, discloses, nor suggests a local binarization device locally binarizing the 
target pixel, judging which of a background and a stroke the target pixel belongs to, and 
outputting a binary image if it is judged that the target pixel is not the background pixel, as 
discussed above with respect to the rejection of claim 4. Claim 26 is thus submitted to be 
allowable for at least those reasons given above with respect to the rejection of claim 4. 
Withdrawal of the rejection of claim 26 is earnestly solicited. 

Claims 27 and 28 depend from claim 26 and add further distinguishing elements. Claims 

27 and 28 are thus also submitted to be allowable. Withdrawal of the rejection of claims 27 and 

28 is also earnestly solicited 

Claim 30: 

Claim 30, as amended, recites: 

The gray level difference is an amount which is calculated based on a difference 
between an average gray level of white pixels in the vicinity area of the target 
pixel and an average gray level of black pixels in the vicinity area of the target 
pixel. 

Seeger neither teaches, discloses, nor suggests a gray level difference is an amount, which is 
calculated, based on a difference between an average gray level of white pixels in the vicinity 
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area of the target pixel and an average gray level of black pixels in the vicinity area of the target 
pixel, as discussed above with respect to the rejection of claim 3. 

Hongo was not asserted to teach, disclose, or suggest a gray level difference is an 
amount, which is calculated, based on a difference between an average gray level of white 
pixels in the vicinity area of the target pixel and an average gray level of black pixels in the 
vicinity area of the target pixel, as recited in claim 30. Claim 30 is thus submitted to be allowable 
for at least those reasons given above with respect to the rejection of claim 3. Withdrawal of the 
rejection of claim 30 is earnestly solicited. 

Claim 31: 

Claim 31 recites: 

Local binarization means for locally binarizing the target pixel, judging which of a 
background and a stroke the target pixel belongs to, and outputting a binary 
image if it is judged that the target pixel is not the background pixel. 

Hongo neither teaches, discloses, nor suggests locally binarizing the target pixel, judging which 
of a background and a stroke the target pixel belongs to, and outputting a binary image if it is 
judged that the target pixel is not the background pixel, as discussed above with respect to the 
rejection of claim 4. Claim 31 is thus submitted to be allowable for at least those reasons given 
above with respect to the rejection of claim 4. Withdrawal of the rejection of claim 31 is 
earnestly solicited. 

Claim 32: 

Claim 32 recites: 

Locally binarizing the target pixel, judging which of a background and a stroke the 
target pixel belongs to and outputting a binary image if it is judged that the target 
pixel is not the background pixel. 

Hongo neither teaches, discloses, nor suggests locally binarizing the target pixel, judging which 
of a background and a stroke the target pixel belongs to, and outputting a binary image if it is 
judged that the target pixel is not the background pixel, as discussed above with respect to the 
rejection of claim 4. Claim 32 is thus submitted to be allowable for at least those reasons given 
above with respect to the rejection of claim 4. Withdrawal of the rejection of claim 32 is 
earnestly solicited. 
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Claim 33: 

Claim 33 recites: 

A gray level difference calculated based on a difference between an average gray 
level of white pixels in the vicinity area of the target pixel and an average gray 
level of black pixels in the vicinity area of the target pixel. 

Hongo neither teaches, discloses, nor suggests "a gray level difference calculated based on a 
difference between an average gray level of white pixels in the vicinity area of the target pixel 
and an average gray level of black pixels in the vicinity area of the target pixel," as discussed 
above with respect to the rejection of claim 4. Claim 33 is thus submitted to be allowable for at 
least those reasons given above with respect to the rejection of claim 4. Withdrawal of the 
rejection of claim 33 is earnestly solicited. 

Allowable Subject Matter: 

The Applicants acknowledge with appreciation the allowance of claims 11 and 14. 

Conclusion: 

Accordingly, in view of the reasons given above, it is submitted that all claims 3-28 and 
30-33 are allowable over the cited references. There being no further outstanding objections or 
rejections, it is submitted that the application is in condition for allowance. An early action to that 
effect is courteously solicited. 

If there are any formal matters remaining after this response, the Examiner is requested 
to telephone the undersigned to attend to these matters. 
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If there are any additional fees associated with filing of this Amendment, please charge 
the same to our Deposit Account No. 19-3935. 

Respectfully submitted, 

STAAS & HAd^EY LLP 



□ate: Zt /^crv6 &y£f(&fa*J 

Whomas E. McKiernan 
Registration No. 37,889 

1201 New York Ave, N.W., 7th Floor 
Washington, D.C. 20005 
Telephone: (202)434-1500 
Facsimile: (202)434-1501 
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